Speech Dereverberation by Constrained and Regularized Multi-channel Spectral Decomposition: Evaluated on Reverb Challenge
نویسندگان
چکیده
We present our contribution to the REVERB Challenge in this paper. A multi-channel speech dereverberation system combines cross-channel cancellation and spectral decomposition. The reverberation is modeled as a convolution operation in the spectral domain. Using the generalized Kullback-Leibler (KL) divergence, we decompose the reverberant magnitude spectrum into clean magnitude spectrum convolved with a deconvolution filter. The magnitude spectrum is constrained and regularized by non-negativity and sparsity, respectively, while the deconvolution filter is constrained by non-negativity and cross-channel cancellation. Spectral decomposition of individual channels and cross-channel cancellation are jointly optimized by a multiplicative algorithm to achieve multi-channel speech dereverberation. Experimental evaluations on “speech enhancement task” are carried out according to the evaluation guidelines of the REVERB challenge, showing promising results. The objective metrics for measuring reverberation are investigated through the algorithm evaluation.
منابع مشابه
Constrained Multichannel Speech Dereverberation
We propose a multi-channel speech dereverberation approach based on cross-channel cancellation and spectrogram decomposition. The reverberation is modeled as a convolution operation in the spectrogram magnitude domain. Using the Itakura divergence (I-divergence), we decompose reverberant spectrogram into clean spectrogram convolved with a deconvolution filter. The speech spectrogram is constrai...
متن کاملJoint noise cancellation and dereverberation using multi-channel linearly constrained minimum variance filter
Speech acquired from an array of distant microphones is affected by ambient noise and reverberation. Single channel linearly constrained minimum variance (LCMV) filters have been proposed to remove ambient noise. In this paper, an algorithm for joint noise cancellation and dereverberation using a multi channel LCMV filter in the frequency domain is proposed. A single channel LCMV filter which a...
متن کاملDual System Combination Approach for Various Reverberant Environments with Dereverberation Techniques
The recently introduced REVERB challenge includes a reverberant speech recognition task. We focus on state-of-the-art ASR techniques such as discriminative training and various feature transformations including Gaussian mixture model, sub-space Gaussian mixture model, and deep neural networks, in addition to the proposed single channel dereverberation method with reverberation time estimation a...
متن کاملCombination of MVDR beamforming and single-channel spectral processing for enhancing noisy and reverberant speech
This paper presents a system aiming at joint dereverberation and noise reduction by applying a combination of a beamformer with a single-channel spectral enhancement scheme. First, a minimum variance distortionless response beamformer with an online estimated noise coherence matrix is used to suppress noise and reverberation. The output of this beamformer is then processed by a single-channel s...
متن کاملThe Tum System for the Reverb Challenge: Recognition of Reverberated Speech Using Multi-channel Correlation Shaping Dereverberation and Blstm Recurrent Neural Networks
This paper presents the TUM contribution to the 2014 REVERB Challenge: we describe a system for robust recognition of reverberated speech. In addition to an HMM-GMM recogniser, we use bidirectional long short-term memory (LSTM) recurrent neural networks. These networks can exploit long-range temporal context by using memory cells in the hidden units, which increases the robustness against rever...
متن کامل